Audio Rendering of Mathematical Formulae Using MathML and AudioMath
نویسندگان
چکیده
Technical, scientific or even simple documents presented online that involve mathematical expressions, issue a big problem with accessibility regarding visually impaired persons. One possible solution is to parse and interpret the mathematical contents and convert them into an audio format. This is a complex and multidisciplinary problem, which AudioMath [1], a work in progress at LPF-ESI [2], studies and aims to contribute to solve. AudioMath provides conversions from mathematical expressions in W3C’s MathML [3][4] format into plain text, something that a capable text-to-speech (TTS) engine would “understand” and read-out. This paper reviews the state of the art in publishing mathematical documents in the Internet, and introduces the AudioMath prototype and its working mechanisms, as an accessibility tool for use together with a TTS engine or to use as a standalone application, with great advantages for visual impaired persons. The main scientific and technical challenges, specifically at the levels of interpretation of the content of the MathML coded expressions and conversion into spoken form, are considered and the current status of the work is described.
منابع مشابه
Enhancing the Accessibility of Mathematics for Blind People: The AudioMath Project
“How can a blind person surpass the difficulty in reading an on-line document’s mathematical expressions? Why wasn’t this completely solved yet? Is it not necessary? Is not easy?” – These questions are only the top of the iceberg of a big problem with accessibility in the Internet. This concerns technical, scientific or even simple documents presented on-line that involve mathematical expressio...
متن کاملPerformance Metrics and Their Extraction Methods for Audio Rendered Mathematics
We introduce and compare three approaches to calculate structureand content-based performance metrics for user-based evaluation of math audio rendering systems: Syntax Tree alignment, Baseline Structure Tree alignment, and MathML Tree Edit Distance. While the first two require “manual” tree transformation and alignment of the mathematical expressions, the third obtains the metrics without human...
متن کاملSpeaking MathML: Using Prosody and Context-Sensitive Inferences to Produce Synthesized Speech
Increasingly, electronic documents containing mathematical expressions are being marked-up using Mathematical Markup Language (MathML). MathML is a XML-based markup language recommended since 1998 by the World Wide Consortium (W3C) for the encoding of mathematics on the Internet. Along with the right authoring tools and rendering software, MathML provides a rich solution to the visual display o...
متن کاملIndexing and Searching Mathematics in Digital Libraries
This paper surveys approaches and systems for searching mathematical formulae in mathematical corpora and on the web. The design and architecture of our MIaS (Math Indexer and Searcher) system is presented, and our design decisions are discussed in detail. An approach based on Presentation MathML using a similarity of math subformulae is suggested and verified by implementing it as a math-aware...
متن کاملThe Declaratron, semantic specification for scientific computation using MathML
We introduce the Declaratron, a system which takes a declarative approach to specifying mathematically based scientific computation. This uses displayable mathematical notation (Content MathML) and is both executable and semantically well defined. We combine domain specific representations of physical science (e.g. CML, Chemical Markup Language), MathML formulae and computational specifications...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2004